Crystalline phase of strongly interacting Fermi mixtures 
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We show that the system of weakly bound molecules of heavy and light fermionic atoms is charac- 
terized by a long-range intermolecular repulsion and can undergo a gas-crystal quantum transition 
if the mass ratio exceeds a critical value. For the critical mass ratio above 100 obtained in our 
calculations, this crystalline order can be observed as a superlattice in an optical lattice for heavy 
atoms with a small filling factor. We also find that this novel system is sufficiently stable with 
respect to molecular relaxation into deep bound states and to the process of trimer formation. 

PACS numbers: 



The use of Feshbach resonances for tuning the interac- 
tion in two-component ultracold Fermi gases of ^Li or *'^K 
has led to remarkable developments, such as the obser- 
vation of superfluid behavior in the strongly interacting 
regime through vortex formation and Bose-Einstein 
condensation of weakly bound molecules of fermionic 
atoms on the positive side of the resonance (the atom- 
atom scattering length a > 0) 0. Being highly excited, 
these extremely large diatomic molecules are remarkably 
stable with respect to collisional relaxation into deep 
bound states, which is a consequence of the Pauli ex- 
clusion principle for identical fermionic atoms 

Currently, a new generation of experiments is be- 
ing set up for studying mixtures of different fermionic 
atoms, with the idea of revealing the influence of the 
mass difference on superfluid properties and finding novel 
types of superfluid pairing. Weakly bound heteronuclcar 
molecules on the positive side of the resonance are unique 
objects dH, which should manifest collisional stability 
and can pave a way to creating ultracold dipolar gases. 

So far it was believed that dilute Fermi mixtures should 
be in the gas phase, like Fermi gases of atoms in two dif- 
ferent internal states. In this paper we find that the 
system of molecules of heavy (mass M) and light (mass 
to) fermions can undergo a phase transition to a crys- 
talline phase. This is due to a repulsive intermolecular 
potential originating from the exchange of light fermions 
and inversely proportional to m. As the kinetic energy of 
the molecules has a prefactor 1/M, above a certain mass 
ratio M/m the system can crystallize. 

We show that the interaction potential in a sufficiently 
dilute system of molecules is equal to the sum of their 
pair interactions and then analyze the case where the 
motion of heavy atoms is confined to two dimensions, 
whereas the light fermions can be either 2D or 3D 0. We 
calculate the zero-temperature gas-crystal transition line 
using Diffusion Monte Carlo (DMC) method and draw 
the phase diagram in terms of the mass ratio and den- 



sity. This phase transition resembles the one for the flux 
lattice melting in superconductors, where the flux lines 
are mapped onto a system of bosons interacting via a 2D 
Yukawa potential 0] . In this case the Monte Carlo stud- 
ies H, Q identified the first order liquid-crystal transition 
at zero and finite temperatures. Aside from the differ- 
ence in the interaction potentials, a distinguished feature 
of our system is related to its stability. The molecules can 
undergo collisional relaxation into deep bound states, or 
form weakly bound trimcrs. We analyze resulting limi- 
tations on the lifetime of the system. 

We first derive the Born-Oppenhcimer interaction po- 
tential in the system of TV molecules. In this approach the 
state of light atoms adiabatically adjusts itself to the set 
of heavy-atom coordinates {R} = {Ri, Rat} and one 
calculates the wavefunction and energy of light fermions 
in the field of fixed heavy atoms. Omitting the interac- 
tion between light (identical) fermions, it is sufficient to 
find N lowest single-particle eigenstates, and the sum of 
their energies will give the interaction potential for the 
molecules. For the interaction between light and heavy 
atoms we use the Bethe-Peierls approach [lo| assuming 
that the motion of light atoms is free everywhere except 
for their vanishing distances from heavy atoms. 

The wavefunction of a single light atom then reads: 



N 



*({R},r) = ^aG„(r-R,), 



(1) 



i=i 



where r is its coordinate, and the Green function sat- 
isfies the equation (— + K^)G'K(r) = S{r). The energy 
of the state ([T]) equals e = —H'^k'^ /2m, and here we only 
search for negative single-particle energies (see below). 
The dependence of the coefficients Ci and k on {R} is 
obtained using the Bethe-Peierls boundary condition: 



*({R},r)cxG,„(r-RO; r ^ R, 



(2) 



Up to a normalization constant, G^o is the wavefunc- 
tion of a bound state of a single molecule with energy 
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eq = — /i^Kg/2m and molecular size Kg 



and ([2|) one gets a set of N equations: J^j ^ijGj 



From Eqs. (P) 
0, 



where Ai 



\{K)5ij + G^{R,j){l - 6ij), Ri. 
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and X{k) = \im.r^o[G K.{r) — G'„o(r)]. The single-particle 
energy levels are determined by the equation 



det [Ay(K,{R})] = 0. 



(3) 



For i?j 



> oo, Eq. ([3]) gives an N-fold degenerate 
ground state with k = kq. At finite large the levels 



split into a narrow band. Given a small parameter 



G^„{R)/Ka\X'^{Ko)\ < 1, 



(4) 



where i? is a characteristic distance at which heavy atoms 
can approach each other, the bandwidth is Ae ;=! 4|eo|^ ^ 
eo|. It is important for the adiabatic approximation that 
all lowest TV eigenstates have negative energies and are 
separated from the continuum by a gap ~ |eo|- 

We now calculate the single-particle energies up to 
second order in ^. To this order we write k(A) w 
kq + k'^X + k'^^X^/2 and turn from (k) to Aij{X): 



1-5, 



(5) 



where all derivatives are taken at A = 0. Using Aij ([5]) in 
Eq. ^ gives a polynomial of degree N in A. Its roots A^ 
give the light-atom energy spectrum = —h?K'^{Xi)/2m. 



The total energy, E = X^iLi ^ii then given by 



E 



N 



N 

K + {nn\)\J2X^ 

i=l 



(6) 

Keeping only the terms up to second order in ^ and using 
basic properties of determinants and polynomial roots 
we find that the first order terms vanish, and the energy 
reads E^Neo + (1/2) Y.^^J U{R,j), where 



U{R)^ KoiKx) 7f 

ml OK 



+ i^^'xyxGl,{R) . (7) 



Thus, up to second order in ^ the interaction in the sys- 
tem of N molecules is the sum of binary potentials ([7]). 

If the motion of light atoms is 3D, the Green function 
is G,,{R) = (l/47ri?) cxp(-Ki?), and A(k) = {ko-k)/^^, 
with the molecular size Kq^ equal to the 3D scattering 
length a. Equation ([7]) then gives a repulsive potential 

U3d{R) = 4|eo|(l - (2Koi?)~')exp(-2Koi?)/Koi?, (8) 



with the validity criterion Kq(kqR) ^ 1. In both cases, 
which we denote 2x3 and 2x2 for brevity, the validity 
criteria are well satisfied already for kqR « 2. 

The Hamiltonian of the many-body system reads: 

H = -(ftV2Af)5] Ar. + (l/2)5]C/(i?,,), (10) 

and the state of the system is determined by two param- 
eters: the mass ratio M/m and the rescaled 2D density 
?iKg"^. At a large M/m^ the potential repulsion domi- 
nates over the kinetic energy and one expects a crystalline 
ground state. For separations Rij < Kq^ the adiabatic 
approximation breaks down. However, the interaction 
potential U{R) is strongly repulsive at larger distances. 
Hence, even for an average separation between heavy 
atoms, R, close to 2/ko, they approach each other at 
distances smaller than Kq ^ with a small tunneling prob- 
abihty P oc cxp{~ (3 y^M/m) <C 1, where /3 ~ 1. We 
extended U{R) to i? < in a way providing a proper 
molecule-molecule scattering phase shift in vacuum and 
checked that the phase diagram for the many-body sys- 
tem is not sensitive to the choice of this extension. 



Using the DMC method [Uj we solved the many-body 
problem at zero temperature. For each phase, gaseous 
and solid, the state with a minimum energy was obtained 
in a statistically exact way. The lowest of the two energies 
corresponds to the ground state, the other phase being 
mctastable. The phase diagram is displayed in Fig. 1. 
The guiding wave function was taken in the Nosanow- 
Jastrow form 1^. Simulations were performed with 30 



particles and showed that the solid phase is a 2D triangu- 
lar lattice. For the largest density we checked that using 
more particles has little effect on the results. 
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and the criterion ([4]) reads (I/kq-R) exp(— kq-R) ^ 1- 
For the 2D motion of light atoms we have Gk{R) = 
{1/2tt)Ko{kR) and A(k) = -(l/27r) ln(K//to), where 
is the decaying Bessel function, and follows from 
This leads to a repulsive intermolecular potential: 

U2d{R) = 4|eo|Ni?A'o(Koi?)/Ci(Koi?) - i^o(«oi?)], (9) 



Figure 1: DMC gas-crystal transition lines for 3D (triangles) 
and 2D (circles) motion of light atoms. Solid curves show the 
low-density hard-disk limit, and dashed curves the results of 
the harmonic approach (see text). 

For both 2x3 and 2x2 cases the (Lindemann) ratio 7 of 
the rms displacement of molecules to R on the transition 
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lines ranges from 0.23 to 0.27. At low densities n the de 
Broglie wavelength of molecules is A ~ 7^ ^ Kq^, and 
U (R) can be approximated by a hard-disk potential with 
the diameter equal to the 2D scattering length. Then, us- 
ing the DMC results for hard-disk bosons 13| , we obtain 
the transition lines shown by solid curves in Fig. 1. At 
larger n, we have A < Kq ^ and use the harmonic expan- 
sion of U{R) around equlibrium positions in the crystal, 
calculate the Lindemann ratio, and select 7 for the best 
fit to the DMC data points (dashed curves in Fig. 1). 

The mass ratio above 100, required for the observation 
of the crystalline order (see Fig. 1), can be achieved in an 
optical lattice with a small filling factor for heavy atoms. 
Their effective mass in the lattice, M*, can be made very 
large, and the discussed solid phase should appear as a 
superlattice. There is no interplay between the superlat- 
tice order and the shape of the underlying optical lattice, 
in contrast to the recently studied solid and supersolid 
phases in a triangular lattice with the filling factor of or- 
der one Our superlattice remains compressible and 
supports two branches of phonons. 

The gaseous and solid phases of weakly bound 
molecules are actually metastable. The main decay chan- 
nels are the relaxation of molecules into deep bound 
states and the formation of trimer states by one light 
and two heavy atoms. A detailed analysis of scattering 
properties of these molecules will be given elsewhere, and 
here we focus on their stability in an optical lattice. 

For a large effective mass ratio M*/m, the relaxation 
into deep states occurs when a molecule is approached 
by another light atom and both light-heavy separations 
are of the order of the size of a deep state. Re 
(lit . The released binding energy is taken by outgoing 
particles which escape from the sample. The rate of this 
process is not influenced by the optical lattice. 

We estimate this rate in the solid phase and near the 
gas-solid transition to the leading order in (koR)^^- At 
light-heavy separations ri^2 ^ ^(7^ the initial-state wave- 
function reads 'I' = B{kq^ , R)tp{ri,r2). Writing it as an 
antisymmetrized product of wavefunctions ([T|), for the 
2x3 case {kq^ = a) we find B « {l/Ra^)ex]){—R/a). 
The quantity W = B^R^ is the probability of having 
both light atoms at distances ~ Re from a heavy atom, 
and the relaxation rate is v^u cx W. As the short-range 
physics is characterized by the energy scale /mR^, we 



restore the dimensions and write 



v-iD = C{h/m){Re/af{l/R^)cyi]){~2R/a) 



(11) 



where R 



The coefficient C depends on a par- 



ticular system and is ^ 1 within an order of magnitude. 
The relaxation rate t'au is generally rather low. For K-Li 
mixture where Re ~ 50A, even at na^ = 0.24 (see Fig. 1) 
the relaxation time exceeds 10 s for n = 10^ cm~^ and 
a = I6OOA. In the 2x2 case, for the same n and Kq'^ the 
probability W is smaller and the relaxation is slower. 



The formation of trimer bound states by one light and 
two heavy atoms occurs when two molecules approach 
each other at distances R ^ Kq^- It is accompanied by 
a release of the second light atom. The existence of the 
trimer states is seen considering a light atom interact- 
ing with two heavy ones. The lowest energy solution of 
Eq. © for = 2 is the gerade state (Ci = C2). Its 
energy e+ (i?) introduces an effective attractive potential 
acting on the heavy atoms, and the trimer states are 
bound states of two heavy atoms in this potential. 

In an optical lattice the trimers are eigenstates of the 
Hamiltonian Hq ^ -(T? j^M^) Ar^ -t- e+(i?i2). In 

a deep lattice one can neglect all higher bands and re- 
gard Rj as discrete lattice coordinates and A as the lat- 
tice Laplacian. Then, the fermionic nature of the heavy 
atoms prohibits them to be in the same lattice site. For 
a very large mass ratio M^,/m the kinetic energy term 
in iJo can be neglected, and the lowest trimer state has 
energy etr ~ e+{L), where L is the lattice period. It con- 
sists of a pair of heavy atoms localized at neighboring 
sites and a light atom in the gerade state. Higher trimer 
states are formed by heavy atoms localized in sites sep- 
arated by distances R > L. This picture breaks down 
at large R, where the spacing between trimer levels is 
comparable with the tunneling energy fi,^/Af»L^ and the 
heavy atoms are delocalized. 

In the many-body molecular system the scale of en- 
ergies in Eq. (|10p is much smaller than |eo|. Thus, the 
formation of trimers in molecule-molecule "collisions" is 
energetically allowed only if the trimer binding energy is 
etr < 2eo. Since the lowest trimer energy in the optical 
lattice is e+(L), the trimer formation requires the condi- 
tion e+(i) ^ 2eo, which is equivalent to > 1.6L in 
the 2x3 case and Kq^ > 1.25i in the 2x2 case. This 
means that for a sufficiently small molecular size or large 
lattice period L the formation of trimers is forbidden. 

At a larger molecular size or smaller L the trimer for- 
mation is possible. For finding the rate we consider the 
interaction between two molecules as a reduced 3-body 
problem, accounting for the fact that one of the light 
atoms is in the gerade and the other one in the ungerade 
state (Ci — — C2). The gerade light atom is integrated 
out and is substituted by the effective potential e+{R)- 
For the ungerade state the adiabaticity breaks down at 
inter- heavy separations R< Kq^, and the ungerade light 
atom is treated explicitly. The wavefunction of the re- 
duced 3-body problem satisfies the Schrodinger equation 



[Ho - fevl/2m - £;]V'({R},r) = 0, 



(12) 



where the energy E is close to 2eo, {R} denotes the set 
{Ri, R2}, and r is the coordinate of the ungerade atom. 
The interaction between this atom and the heavy ones is 
replaced by the boundary condition dJ) on ^. The 3-body 
problem can then be solved by encoding the information 
on the wavefunction -0 in an auxiliary function /({R}) 



4 



[lit ^^'^ representing the solution of Eq. p2|) in the form: 

i;=Y^ x.({R}k:({R})/({R})i^K.(r,{R}), (13) 

where ^[^({R-}) is an eigenfunction of Hq with energy e^, 
a ndf^^(r,{R}) = Gk„ (r - Ri) - G^^ (r - R2) with = 
■y/2m(e^ — E)/h?. For < E the trimcr formation in 
the state is possible. This is consistent with imaginary 
Ki, and the Green function G„_^ describing an outgoing 
wave of the light atom and trimer. 

We derive an equation for the function / in a deep 
lattice, where the tunneling energy h'^/M^,L^ <^ |eo|. 
Then the main contribution to the sum in Eq. (|13p 
comes from the states i' for which je^ — e+(i?i2)| < 
fi? /M^.Lr' . The sum is calculated by expanding around 
i^iRu) = ■\/2m(e+(i?i2) ~ E)/h? up to first order in 
(e^ — e+(i?i2))/eo and using the equation {Hq — €,^)xi> = 0. 
The equation for / is then obtained by taking the limit 
r — > Ri in the resulting expression for ijj and comparing 
it with the boundary condition ([2]). This yields 



^{h^/2M,) ARi +f/cff(i?12)]/(Rl,R2) 

1=1,2 



:0, (14) 



where the effective potential Uca{Ri2) is given by 



f/eff(i?) 



m {d/dK)[X(K(R))-G^^R^{R)y 



(15) 



At large distances one has Ucs « U{R) + 2eo — E, 
and for smaller R where e+{R) < E, the potential [/off 
acquires an imaginary part accounting for the decay of 
molecules into trimers. The number of trimcr states that 
can be formed grows with the molecular size. Eventually 
it becomes independent of L and so does the loss rate. 

In this limit, wc solve Eq. (fTi]) for two molecules 
with zero total momentum under the condition that 
/(Ri,R2) is maximal for |Ri — R2I = R ~ n~^l'^. 
We thus obtain £' as a function of the density and 
mass ratio, and its imaginary part gives the loss rate 
V for the many body system. Numerical analysis for 
0.06 < 71^(7^ < 0.4 and 50 < M»/m < 2000 is wch fitted 
\yS V K, {DKnlM^)[nK^'^)%-yL\>{-J^M^Im), with D = 1 
and J = 0.95-1.4(n/t|7^) for the 2 x 3 case, and £> = 10^, 
J = 1.45 — 2.8(nK[^^) in the 2x2 case. One can sup- 
press V by increasing M^jm^ whereas for M^/m < 100 
the trimers can be formed on a time scale r < 1 s. 

In conclusion, we have shown that the system of weakly 
bound molecules of heavy and light fermionic atoms can 
undergo a gas-crystal quantum transition. The necessary 
mass ratio is above 100 and the observation of such crys- 
talline order requires an optical lattice for heavy atoms, 
where it appears as a superlattice. A promising candi- 
date is the ^Li-^'^K mixture as the Li atom may tunnel 
freely in a lattice while localizing the heavy K atoms to 



reach high mass ratios. A lattice with period 250 nm 
and K effective mass M*=: 20M provide a tunneling rate 
^ 10^ s~^ sufficiently fast to let the crystal form. Near a 
Feshbach resonance, a value a = 500 nm gives a binding 
energy 300 nK, and lower temperatures should be reached 
in the gas. The parameters uKq'^ of Fig. 1 are then ob- 
tained at 2D densities in the range 10^ — 10^ cm~^ easily 
reachable in experiments. For n = 10^ cm~^ the rate of 
the trimer formation is of the order of seconds, and these 
peculiar bound states can be detected optically. 
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